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LEARNING (TRAINING) MODE 



Select class of gesture 
to be learnt Gk 



A4- 



Select command Ck to be associated 
to selected class of gesture 



A6- 



Perform gesture 



A8 



A10 



\ 



Determine 2n-dimensional 
signature vector of gesture 






Store in memory the y signatures 
(SI, S2, S3, Sy) 


\ 





A12- 



Supervised 
learning 
paramaters 



Repeat A6, A8 to 
obtain y signatures 



Store in memory correspondence 
between signatures (S1,S2,S3,....,Sy) 
and : 

-Selected class of gesture Gk 
-Selected command Ck 



Parameter values of S3 for 
2 sensors : [PaSF1, PbSF1, 
PaSF2,PbSF2, PaSF3,PbSF3,. 
...PaSFn, PbSFn] 



Memory storage 




Gk * = Ck 



FIG.3 



Detect start of gesture under 
identification Gc 
(When signal 14 > Sthresh) 
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IDENTIFIC ATION (RECOGNITION) MODE 

^A14 



TIME SCALE 



to 



Accumulate signal level 
& envelope data 



s 



A16 



Set i = 



-A18 



No 



End of sub-frame SFi 
reached ? 



Yes 




A20 



Determine parameter value 
Psfi for env. portion in 
sub-frame SFi 



A22 



ti 



Add as corresp. new component 
to signature vector Sc 



Perform nearest neighbour analysis 
with learnt corpus for current 
signature vector Sc 



-A24 



A26 



Store class of gesture attributed to 
identified nearest neighbour 



A28 



Next i 



ti+2 



Decision i 


algorithm 


yA30 




— » — » 


Output decision : selected identification 
of attributed class of gesture G / & 
command C 



A32 



FIG.4 



5/10 




4—1 
















4-J 


CD 




ZD 




O 


i— 


o 


c 


4— > 






LT) 
CD 


c 




on 


ro 


CD 


«4— 

o 


E 


■a 




E 




las 


CO 




U 








cL 


na 


Q_ 

^) 


CD 


.2P 


CU 






l_ 
L- 


o 




o 


u 






+ 


4-J 












E 


J 




4— l 






Ln 






CD 






CQ 







LO 

o 



6/10 




c 

o 



QJ 
_Q 

£ *> 



o o 

CL 





SF8 


/ 


SF7 




/ 




SF6 


/ 


/ LT> 
V ^° 








Ll. 
on 




/ Li- 

/ ^° 




/ 




SF2 





u 

> — 

CD 

\ — " 
J-J — 
c 

•2P A 



7/10 



Recognised class Corresponding 
of gesture Media player command 





Pointing finger 



play 




FIG.7a 




Producing extended palm 



Stop 




F!G.7b 




Rotating a wrist 



Seek-ff 
or song search 



FIG.7c 
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Recognised class 
of gesture 



Corresponding 
Media player command 




Forming a fist 




pause / mute 



FIG.7d 



Flexing wrist (inward) 



Next track 




FIG.7e 



Flexing wrist (outwards) 



Previous track 



FIG.7f 
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